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ABSTRACT 



As part of its Jobs Initiative (JI) program in six 
metropolitan areas Denver, Milwaukee, New Orleans, Philadelphia, St. Louis, 
and Seattle the Annie E. Casey Foundation sought to develop and test a method 
for establishing benchmarks for workforce development agencies. Data 
collected from 10 projects in the JI from April through March, 2000, included 
measures of program participant levels at specific milestones program 
enrollment, training completion, placement and retention measures, and costs. 
Performance measures were determined by developing a program flow model, and 
participating organizations received 6- and 12 -month reports summarizing 
their performance relative to that of their peers. The study found that the 
programs had different levels of financial resources and applied them to 
expenses in different ways, that the programs operated at different volumes, 
and that the number of placements were significantly correlated with age of 
the programs (longer -running programs had more placements and retentions) . 
Policy implications of the benchmarking project include the following: (1) 

effective workforce development programs must measure retention; (2) the true 
costs of employment and training must be understood; (3) measurement 
standards are critical for benchmarking; (4) benchmarking is not the same as 
evaluation; and (5) managers may find tracking only their program over time 
as valuable as comparisons with other programs. (Profiles of the programs are 
included in the report.) (KC) 



Reproductions supplied by EDRS are the best that can be made 
from the original document. 



Of"3 J I / 



Jobs Initiative Policy Report 



oo 

\D 

O 



\o 



Q 



W 



U.S DEPARTMENT OF EDUCATION 

Office of Educational Research and Improvement 
EDUCATIONAL RESOURCES INFORMATION 
/ CENTER (ERIC) 

This document has been reproduced as 
received from the person or organization 
originating it. 

□ Minor changes have been made to 
improve reproduction quality. 



< * Points of view or opinions stated in this 

document do not necessarily represent 
official OERI position or policy. 



PERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL HAS 
BEEN GRANTED BY 






'*V — > 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 



Benchmarking the Performance of 
Employment and Training Programs: 



A Pilot Effort of the Annie E. Casev Foundation’s 
Jobs Initiative 



Doug Welch, Abt Associates Inc. 1 
March 2001 



This research brief is the fifth in a series of updates related to issues around 
retention and advancement for low-income residents and lessons learned 
from the Annie E Casey Jobs Initiative. The report benefited enormously 
from comments from Susan Gewirtz and Robert Giloth of the Annie E. 
Casey Foundation and contributions and editorial assistance from Wendy 
Fleischer and Ed Hatcher of the Hatcher Group. 



1 Abt Associates is the lead evaluator of the Annie E. Casey Foundation’s 8-year Jobs Initiative. Doug Welch currently 
directs the evaluation. 
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Introduction 

As in many social change endeavors, funders and practitioners in the 
workforce development field are likely to establish outcomes and 
performance measures by which they can gauge the success of their 
activities. However, the advent of time-limited, work-based welfare and the 
corresponding proliferation in workforce development efforts aimed at very 
low-income people has taken place without the benefit of commonly 
accepted standards of achievement for these efforts. Welfare reform can still 
be said to be in the experimental stage and workforce organizations are 
experimenting with new approaches for different target populations. 
Therefore, although workforce organizations are often held to benchmarks 
set by their Boards of Directors or funders, these measures are often 
established in the absence of a set of objective standards about what 
outcomes are realistic to expect or what they will cost to attain. 

Last year, The Annie E. Casey Foundation contracted with Abt 
Associates Inc. to conduct a 12-month study of employment programs in the 
Foundation-funded Jobs Initiative as well as a few innovative employment 
programs that are not in the Jobs Initiative. The purpose of this study was to 
investigate performance benchmarks for these employment programs, all of 
which are serving very low-income people. Performance benchmarks are 
standard measures that can serve to assess the operating efficiency of a 
program. The practice of benchmarking has migrated into the nonprofit and 
government sectors after becoming popular in the business world. 2 Program 



2 

See Letts, Christine W., Ryan, William P. and Grossman, Allen, “Benchmarking: How Non-Profits are Adapting a 
Business Planning Tool for Enhanced Performance”, The Grantsmanship Center Magazine , Winter 1999. 



